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[57] ABSTRACT 

The invention provides an information retrieval apparatus 
and an information retrieval method by which information 
can be retrieved in an improved operability. A CPU controls 
a video camera to fetch an image and controls a GPS to 
detect a current position. The CPU reads out, from within 
image data stored in a corresponding relationship with URLs 
of WWW servers, those image data which correspond to 
position data regarding positions around the detected current 
position from a WWW data base via a modem and a host 
machine. Then, the CPU selects, from among the read out 
image data, that image data which matches with the fetched 
data, reads out a URL corresponding to the image data and 
accesses a WWW server designated by the URL. 

5 Claims, 7 Drawing Sheets 
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INFORMATION RETRIEVAL APPARATUS mined host machine (access provider) 54 connected to the 

AND METHOD Internet and then access the WWW server 51 from the host 

machine 54. 

BACKGROUND OF THE INVENTION Accordingly, accessing to a WWW server 51 is normally 

This invention relates to an information retrieval appara- 5 performed indoors such as in an office in which, such work 

tus and method, and more particularly to an information station 52 is provided or in a house of an individual who 

retrieval apparatus and method wherein an image is fetched owns such personal computer 53. 

and a current position is detected and then, based on the Accordingly, for example, when it is intended to acquire, 

position detected, image data which conforms with the during shopping in a town, information of a certain shop in 
fetched image is selected from among image data selectively 10 the town from a home page of the WWW, it is a possible 

stored in advance and a URL or the like corresponding to the procedure, for example, to connect a portable telephone set 

selected image data is retrieved. 56 to a portable personal computer 55 provided with a 

In the Internet which is a world-wide computer network, modem, log in to the host machine 54 and access a WWW 

a WWW (World Wide Web) which provides various infor- server 51. 

mation has been established. In such an instance, however, a URL (Uniform Resource 

Here, for an information providing system available on locator) of the home page which ' P^^™5™ ° g f 

the Internet WWW developed by CERN (European Center the shop must be remembered in advance. Further where a 

o S c^ Potable telephone set is connected to and used wi h a 

oTI't^ inUd using a Keyboard, ^is low when the 

stored in a WWW server terminal is sent asynchronously to system is used outdoors such as in a town. 

terminals such as personal computers. SUMMARY OF THE INVENTION 

The WWW server is constituted by server software called 25 

HTTP demon and HTML file in which hyper text informa- it is an object of the present invention to provide an 

tion is stored. The hyper text information is described in a information retrieval apparatusof a comparatively small size 

description language called HTML (Hyper Text Makeup which does not require use of a keyboard and is high in 

Language). In the description of a hyper text by HTML, a operability. 

logical structure of a document is expressed in a format 30 j t ^ another object of the present invention to provide an 

specification called tag enclosed by and ">". Description information retrieval method which does not require use of 

of linking to other information is made based in link a keyboard and allows a good operability of an information 

information called anchor. A method in which a location at retrieval apparatus. 

which required information is stored by the anchor is URL Iq ordef tQ attaifl tne OD j ccts described above, according 
(Uniform Resource Locator). 35 tQ p resent invention, image data are stored in advance in 

A protocol for transferring a file described in HTML on predetermined storage locations corresponding to informa- 

the TCP/IP network is HTTP. This protocol has a capability tion t0 be provided, and an image fetched by a user is 

of transferring a request for information from a client to the compared with the image data stored in advance and infor- 

WWW server and the requested hyper text information ma tion corresponding to the image data conforming to the 
stored in the HTML file to the client. 40 image is read out. 

Used by many as an environment for using WWW is In particular, according to an aspect of the present 

client software such as Netscape Navigator (trademark) invention, there is provided an information retrieval appa- 

called WWW browser. ralus for retrieving information from a data base which has 

Using the WWW browser, a file on a WWW server on the registration data including position data, image data and 

Internet which spreads in a world-wide scale corresponding designation information such as a URL for specification of 

to a URL, a so-called home page, can be automatically individual information in a mutually corresponding 

down-loaded, and as is called netsurfing, a network service relationship, comprising fetching means for fetching an 

wherein home pages which are linked to each other are image, position detection means for detecting a current 
successively traced to observe various information sources ^ position of the information retrieval apparatus, and selection 

of WWW can be enjoyed. means for selecting, from within the image data having the 

It should be noted that demon denotes a program for position data regarding positions around the current position 

executing control and processing in the background when detected by the position detection means, that of the desig- 

performing a job in the UNIX environment nation information having image data which matches with 

FIG. 8 illustrates a manner in which a terminal equipment 55 the image fetched by the fetching means, 

such as a WWW server is connected to the Internet. In the information retrieval apparatus, the fetching means 

Referring to FIG 8, the WWW includes a large number fetches an image, and the position detection means detects 

of W^servers 51 connected to the Internet. TTie WWW a current position of the information retneval apparatus, 

servers 51 provide home pages of the hyper text form and so TTien, the selection means selects from within the xrnage 
tab to other terminal eq^ments connected to the Internet 60 data having the posmon data «^.P<^^ £ 

in response to accesses from them. current posUion detected by the position detecUon means 

j , 4 . n www S1 as described that of the designation information having image data which 

ab ve^ch" J^fc'tTLT^SS ^ - * ~ „ 

such as a work station 52 connected to the Internet is According to another aspect of the present invention, 
manually operated to access the WWW server 51 or a 65 there is provided *n information retneval method for retnev- 

popular personal computer 53 to which a modem is con- tog information from a data base which has region data 

nected isused to log in, via a telephone line, to a predeter- including position data, image data and designation infor- 
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mation for specification of individual information in a In the example of display shown in FIG. 2, "hup:// 
mutually corresponding relationship, comprising the steps of www.taxim.co.jp" is entered as the URL; "40_/ 13" 1(T " is 
fetching an image, detecting a current position, and entered as the latitude (position data); "135_7 40* 05"" is 
selecting, from within the image data having the position entered as the longitude (position data); and "Poster!" is 
data regarding positions around the detected current 5 entered as the name (file name) of image data, 
position, that image data which matches with the fetched Then, if a mouse or the like is manually operated to click 
image. a registration button at a lower portion of the screen shown 

In the information retrieval method, an image is fetched in FIG. 2, then those data described above are registered into 
and a current position is detected. Then, from with in the the WWW data base 3 via the Internet. Further, if an image 
image data having the position data regarding positions ™ display button is clicked, then an image of the file entered in 
around the detected current position, that image data which the image data section is displayed, for example as seen in 
matches with the fetched image is selected. FIG. 3. Consequently, contents of the image data to be 

With the information retrieval apparatus and the informa- registered can be confirmed. . , , . . u 

tion retrieval method, image data is read out from the data When the current position of a portable terminal 1 is in the 
base based on a position when an image is fetched by a user, 15 proximity of the latitude of 40_/ 13' 10" and the longitude 
and information such as a URL corresponding to image data of 135^ 40' 05", since such registration data as seen in FIG. 
matching with the image fetched by the user is read out from 2 coincide with the current position in retrieval of the 
the data base. Consequently, the necessity for use of a position by the portable terminal 1, the WWW data base 3 
keyboard is eliminated. Further, since no keyboard need be outputs the image data (data of Posterl) of the registration 
provided, the apparatus can be formed in a reduced size and 20 data to the portable terminal 1 via a host machine (access 
have an improved operability. provider) 4. 

Hie above and other objects, features and advantages of The WWW data base 3 holds the URL of the WWW 
the present invention will become apparent from the fol- server 11 in a corresponding relationship to the image data 
lowing description and the appended claims, taken in con- 2$ and the position data supplied thereto from the information 
junction with the accompanying drawings in which like provider 2. 

parts or elements are denoted by like reference characters. The host machine 4 is connected to the portable terminal 

1 by a telephone line (by radio), and accesses the WWW 
BRIEF DESCRIPTION OF THE DRAWINGS data base 3 or the WWW server 11 via the Internet in 

FIG. 1 is a block diagram showing a coo-r«*» of an 30 ^ 
information retrieval system which employs a portable ter- 

server 11 to the portable 

minal to which an information retrieval apparatus of the ww ." u * ia u 

*• ■ 4. terminal 1. 

present invention is applied, The portable terminal 1 fetches an image and detects a 

HQ. 2 is. schematic ci^sUion thereof. Then, the por^ble terminal 1 

d^play screen upon ^registration of a URL by an information data ^ the camai position f rom 

provider shown in HCr. 1; ^ ww 6 ^ bage 3 via the hosl mach ine 4 and 

FIG. 3 is a schematic illustration showing an example 01 ^ image data correspon di n g to the position data from 

a display screen of image data registered in a corresponding ^ data base 3 via lhe hosl mac hine 4. 

relationship to a URL; 4Q Furtherj lhe portable terminal 1 selects that of the image 

FIG. 4 is a block diagram showing an example of a ^ Ued from thc www data base 3 which 

detailed construction of the portable terminal shown in FIG. conforras to me fetched image (that image data which is 
1; discriminated to be an image of a picture or characters same 

FIG. 5 is a flow chart illustrating operation of the portable as a p j cture (pattern) or characters exhibited in the fetched 
terminal of FIG. 4; 45 image) and reads out a URL corresponding to the image data 

FIG. 6 is an illustration showing a manner in which an from the WWW data base 3 via the host machine 4. 
image is fetched using the portable terminal of FIG. 4; FIG. 4 shows an example of a detailed construction of the 

FIG. 7 is a schematic view showing an example of a portable terminal 1. Referring to FIG. 4, the portable termi- 
display of a home page provided by a WWW server; and na l 1 shown includes a CPU (selection means) 21 which 

FIG 8 is a block diagram showing terminal equipments 50 performs various processes in accordance with a program 
connected to the Internet. stored in a ROM 22. A RAM 23 temporarily stores data 

when the CPU 21 performs processing. 
DESCRIPTION OF THE PREFERRED A ^deo camera 24 serving as fetching means fetches an 

EMBODIMENT image around the same and outputs the fetched digital image 

Referring first to FIG. 1, there is shown an example of an 55 data to the CPU 21 via an interface 25. 
information retrieval system which makes use of an infer- A GPS (Global Positioning System) 26 serving as position 
mation retrieval apparatus of the present invention. detection means detects a current position such as a latitude 

In the information retrieval system, an information pro- and a longitude at which ; ihc P 0 ^^^.^^^ 
vider 2 can make a WWW server 11 thereof hold informa- 60 at present, and outputs the position data to the CPU 21 via 
tion provided from the same and register a file or a home the interface 25. 

page (HTML file) stored in the WWW server 11 into a A modem 27 serving as reception means outputs, under 
WWW data base 3 via the Internet. the control of the CPU 21, a predetermined signal to the host 

When a URL of a home page in the WWW server 11 is machine 4 via the telephone line (by radio). Further, the 
registered into the WWW data base 3, for example, columns 65 modem 27 supplies a signal from the host machine . 4 
or sections into which a URL, position data (latitude and transmitted thereto via the telephone line (by radio) to the 
longitude) and image data are displayed as seen in FIG. 2. CPU 21 via the interface 25. 
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A CRT 28 displays an image of an acquired URL or home In step S4, the CPU 21 of the portable terminal 1 checks 

page under the control of the CPU 21. whether or not the image data read out from the WWW data 

A manually operable button 29 is manually operated to base 3 matches with (corresponds to) the image fetched from 

fetch an image by means of a video camera 24 or to select the video camera 24. Then, in step S5, the CPU 21 checks 

a URL from among a plurality of URLs displayed on the 5 the number of matching images, and if no matching image 

CRT 28, and outputs a signal corresponding to the operation is detected, then the processing is ended. However, when an 

to the CPU 21 via the interface 25. image or images match, the CPU 21 discriminates, in step 

Subsequently, operation of the portable terminal 1 will be S6, whether or not the number of matching images is 1 If 

described with reference to a flow chart of FIG. 5. * e of matchm S 1S lhen the contro1 

First in step SI, when a user manually operates the "> se 1 ueilce advances t0 S7 ' . 

manually operable button 29, a signal representative of the For example, when an image is read in in such a situation 

operation is supplied to the CPU 21, and the video camera as seen in FIG. 6 and such image data as seen in FIG. 3 are 

24 fetches, under the control of the CPU 21, an image supplied to the portable terminal 1, since the poster shown 

around the same in a direction in which the portable terminal in FIG. 6 is drawn in a similar design to the image data of 

1 is directed. The video camera 24 supplies the thus fetched 15 FIG. 3, the CPU 21 of the portable terminal 1 discriminates 

image data to the CPU 21 via the interface 25. The CPU 21 that the image data (FIG. 3) matches with the fetched image 

stores the image data into the RAM 23. (FIG- <»)• 

It is assumed that the user is walking in a town carrying In step S7, the CPU 21 requests, via the modem 27, the 

the portable terminal 1. Further, it is assumed that, in the WWW data base 3 to transfer of a URL corresponding to the 

town, for example, such a poster 41 as shown in FIG. 6 is 20 conforming image. When the URL corresponding to the 

put up on a board. When the user is interested in the poster conforming image is acquired from the WWW data base 3, 

41 and tries to acquire detailed information relating to this, the portable terminal 1 accesses, in step S8, a WWW server 

the user fetches an image of the poster 41 using the video 11 which has the URL. 

camera 24. In the example shown in FIG. 6, an image of the i n response to the accessing, the WWW server 11 outputs 

poster of "Restaurant Taxim de Paris" is fetched. i ma ge data of the home page to the portable terminal 1. The 

Then in step S2, the CPU 21 instructs the GPS 26 to detect portable terminal 1 receives, in step S9, the image data by 

the current position of the portable terminal 1. The GPS 26 means of the modem 27 and sends the image data to the CRT 

supplies the detected position data to the CPU 21 via the 28 so that they may be displayed on the CRT 28. 

interface 25. The CPU 21 stores the position data into the 3Q p or example, when such registration data of "Restaurant 

RAM 23. Taxim de Paris" as seen in FIG. 2 are searched out in the 

Since the user has fetched the image at the position of, for retrieval, a URL of "http://www.taxim.co.jp" is read out 

example, the latitude of 40_/ 13' 09" and the longitude of fr 0m the WWW data base 3 and supplied to the portable 

135_J 40' 06" as seen in FIG. 6, the GPS 26 detects this terminal 1 via the host machine 4. 

position (latitude of 40_J 13' 09" and longitude of 135^ 40' 35 the porta bl e terminal 1 accesses the WWW server 

06") and outputs the position data to the CPU 21. ^ designated by http://www.taximxo.jp and receives such 

In step S3, the CPU 21 requests the WWW data base 3 data of the home page of "Restaurant Taxim de Paris" 

through the modem 27 to perform retrieval of position data as i n piG. 7 from the WWW server 11. The image data 

based on the position data supplied from the GPS 26. are displayed on the CRT 28 of the portable terminal 1. 

The WWW data base 3 retrieves those of the position data 40 0n tne omer h an d, when it is discriminated in step S6 that 

of the registration data which are data around the position numDer D f matching images is two or more, the control 

supplied from the portable terminal 1 (that is, those position sequence advances to step S10, in which the portable 

data which have coordinate values (in latitude and terminal 1 requests the WWW data base 3 to transfer URLs 

longitude) within a predetermined distance from the current corresponding to all of the conforming images, 

position detected by the portable terminal 1). The WWW 45 ^ faost machine 4 thus URLs corresponding to 

data base 3 then reads out image data of the registration data aU rf ^ conforming from the WWW data base 3 

corresponding to the thus retrieved position data and outputs ^ Qutputs ^ tjrls t0 the portable terminal 1. The 

them to the portable terminal 1. portable terminal 1 receives the URLs and controls the CRT 

For example, when an image is fetched in such a situation 2g tQ display them 

as seen in FIG. 6, since the position detected by ^ portable 50 { §u he user will manuaUy operate the 

terminal 1 is 40_J 13' 09" in latitude and 135_V 40' 06" in P fc ^ ^ {q ^ Qne of ^ URU 

longitude, the WWW data base 3 searches for ^those ^of the ^ ^ ^ CRT ^ ^ cpu 21 QUtputs {he 

registered data whose position data is around 40_V 13 09 ^ ^ ^ ^ (hc mQdem 2? Consequen tly, 

in latitude and 135_7 40' 06" in longitude. accessing to the WWW server 11 designated by the URL is 

Then, for example, if the restaurant named Taxim de Pans 55 formed in step 

which acts as the information provider 2 has put the poster 4 ^ ^ home page fe 

41 on a board as an advertisement and ha" home page of u b . {hQ ^ 

WWW produced in a predetermined WWW server 11 and ^ ^ ^ 

besides has an toage and the locahcn of the . poster ^ 41 ™ o ^ g p ^ ^ ^ ^ ^ 

registered in the WWW data base 3 as seen in FIG. 2, since 60 P > p received, 

the location of the poster (40_J 13' 10" in latitude and 135^ display the image of the .home , pag* ™ 

40' 05" in longitude) is in the proximity of the current In this manncr^teportrfilc te fr m1 ^ 1 ^ e ^^1 

position (40 / 13' 09" in latitude and 135 _J 40' 06" in a predetermined WWW server from the WWW data base 3 

LnSde Twmch to user has fetched theYmage, image making use of a fetched image and data of the current 
data(FIG ^ 3) of the registration of the poster 41 is retrieved 65 position, and accesses the WWW server, 

from the WWW data base 3 and supplied to the portable It is to be noted that, while, in the embodiment described 

terminal 1 via the host machine 4. above, an information retrieval apparatus of the present 
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invention is applied to the portable terminal 1, it may 
otherwise be applied to a vehicle-carried terminal. In this 
instance, a URL is registered together with image data of 
road -signs, signboards and billboards along a road and 
detailed information is stored in a predetermined WWW 
server in advance. Then, when a user fetches an image of one 
of the road-signs, signboards and billboards, detailed infor- 
mation of it is read out from the predetermined WWW 
server. 

Further, while, in the embodiment described above, the 
portable terminal 1 accesses the WWW data base 3 to 
perform retrieval when an image is fetched, image data and 
position data may be stored once into the RAM 23 so that, 
later at a different location (for example, after the user comes 
home), retrieval may be performed making use of the image 
data and the position data. 

Furthermore, while, in the embodiment described above, 
the GPS 26 is utilized for detection of a position, the PHS 
(Personal Handy phone System) may be utilized alterna- 
tively. Since the PHS employs comparatively weak radio 
waves, a radio wave of a PHS terminal arrives only at a 
neighboring relay station or stations. Accordingly, in other 
words, when a relay station receives a radio wave, a PHS 
terminal is used around the relay station. Consequently, the 
position (region) in which a PHS terminal is used can be 
specified to a narrower range. 

Further, where a PHS circuit is provided in the modem 27, 
communication with the host machine 4 and position detec- 
tion can be performed by the PHS circuit. Consequently, the 
GPS 26 is unnecessary. Accordingly, the number of parts of 
the portable terminal 1 can be reduced, and the portable 
terminal 1 can be formed as an apparatus of a reduced size. 

In addition, while, in the embodiment described above, a 
WWW of the Internet is utilized, it is otherwise possible to 
built up a similar system in a computer network other than 
the Internet to perform retrieval of information. 

Having now fully described the invention, it will be 
apparent to one of ordinary skill in the art that many changes 
and modifications can be made thereto without departing 
from the spirit and scope of the invention as set forth herein. 

What is claimed is: 

1. An information retrieval apparatus for retrieving infor- 
mation from a data base which contains registration data 
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15 



30 



35 



40 



including position data, image data and designation infor- 
mation for retrieval of additional information comprising: 

imaging means for obtaining an image; 

location detection means for detecting a current position 
location of said information retrieval apparatus; and 

selection means for selecting image data from said data 
base which corresponds to the image obtained by said 
imaging means, said image data having position data 
representing positions in the vicinity of the current 
position location detected by said location detection 
means, and said designation information corresponding 
to said image data for retrieving said additional infor- 
mation. 

2. An information retrieval apparatus according to claim 

1, further comprising reception means for receiving the 
image data and the designation information via a computer 
network. 

3. An information retrieval apparatus according to claim 

2, wherein said reception means has a portable telephone 
function and is connected to said computer network via a 
telephone line. 

4. An information retrieval apparatus according to claim 
2, wherein the designation information is a URL for speci- 
fying information stored in a server of a world wide web 
build up on the Internet. 

5. An information retrieval method for retrieving infor- 
mation by information retrieval apparatus from a data base 
which contains registration data including position data, 
image data and designation information for retrieval of 
additional information, comprising the steps of: 

obtaining an image; 

detecting the current position location of the information 
retrieval apparatus; and 

selecting image data from said data base which corre- 
sponds to the image obtained, said image data having 
position data representing positions in the vicinity of 
the detected current position location of the information 
retrieval apparatus, and designation information corre- 
sponding to said image data for retrieving said addi- 
tional information, 
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